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ABSTRACT 

A naw algor Ittn Is presented for solution 
of dynaiic optimisation problems which are non- 
linear In the state variables and linear In the 
control variables. It is shown that the optimal 
control is bang-bang. A noelnal bang-bang solu- 
tion is found which satisfies the syatem equa- 
tions and constraints, and influence functions 
are generated which check the optimality of the 
solution. Nonlinear optimization (gradient 
search) techniques are used to find the optimal 
solution. The algorithm is used to find a mini- 
mum time acceleration for a turbofan engine. 


I. INTRODUCTION 

In recent years, linear-quadratic regulator 
theory has been developed for the design of 
multi-input, multi-output control systems. An 
account of the theory and application is given, 
for example. In reference 1. Use of the theory 
has beei facilitated by computer programs such as 
those described In references 2 and 3, which rap- 
idly and efficiently calculate the optimal feed- 
back control gains, given the system description 
and performance Index. 

In addition to the design of regulators, the 
problem of minimizing the time required to trans- 
fer from one set point to another is also impor- 
tant; this problem cannot be solved systemati- 
cally by use of linear quadratic regulator theory. 
Minimum-time trajectory optimization has been con- 
sidered by many Investigators for many years. 
Athans and Falb (ref. 4) give a good account of 
the literature dealing with time optimal systems 
in their chapter 7. However, nearly all of their 
discussion Is concerned with problems having only 
a single control variable. Furthermore, the sys- 
tems are assumed to be linear and time Invariant, 
and the control limits are not dependent on the 
state or time. It is shown that the optlm»l con- 
trol for such problems is bang-bang; ^.e., the 
control always operates at either f’.ie upper or 
the lower limit. 

Wolske (ref. 5) considered the problem of 
fuel-optimal control of a dynamic systMi which is 
nonlinear in the state and linear In the control. 


The controls are assumed to be bounded In isagnl- 
tuda, and the resulting optimal control Is bang- 
bang. The problem Is solved by linearizing about 
a nominal history, which is neither optimal nor 
feasible (l.e.. It does not satisfy the terminal 
constraints). The optimality condition and term- 
inal constraints are expressed as linear inequal- 
ities, and linear programming techniques are used 
to improve the solution until a feasible optimum 
Is attained. 

In this report, a new algorithm Is developed 
for solution of dynamic optimization problems 
which are nonlinear in the state vari'^bles, and 
linear in the control variables. Specifically, 
the problem considered Is to minimize a perform- 
ance Index subject to satisfaction of the system 
dynamic equations, a set of terminal constraints 
(the number of which may be less than or equal to 
the number of states) and path Inequality con- 
straints. The performance Index, system equations 
and path constraints are all linear In the control 
variables, 

It Is shown that the optimal control Is bang- 
bang, except for possible singular arcs, which are 
not considered. The algorithm requires that a 
nominal bang-bang solution be found that satisfies 
the system dynamic equations and terminal con- 
straints. Once such a feasible solution has been 
found. Influence functions are generated which 
check the optimality of the solution and determine 
whether or not additional control switches are 
needed. Nonlinear optimization (gradient search) 
techniques are used to find the values of Che con- 
trol switching times which result in a minimizing 
solution. The nonlinear optimization technique 
described in reference 6 is used to generate the 
numerical results presented in this report. 

This algorithm is Chen used to find a minimum 
time acceleration history for the FIDO engine, a 
two-spool Curbofan engine used to power the F15 
and F16 aircraft. A plecewlse-llnear engine model 
Is used. The linear models used In this report 
were obtained by linearization of a nonlinear 
model at five equilibrium points, and were taken 
from reference 7. The linear model which applies 
at a given time In the trajectory is determined by 
calculating a normalized "distance" from the cur- 
rent state to the state at each of the equilibrium 
points; the linear model associated with Che 


STAR Category 63 


clo««*t •qulllbrltni point !■ than uaad. Tha mo4al 
haa thraa atataa and four controls. In additloni 
thara ara llnaar atata/control constralnta which 
eorraspottd to spaad« tanparaturat prasaura, and 
Mchanlcal control llnlts. 

II. A NONLINEAR (^IMIZATION PROSLEH, 

LINEAR IN CONTROL 

ProblMi Statanant 


H ■ a(*,t) + b^(«,t)u + l^[flx,t) + |(x.t)u3 

q 

+ u^L^(x.t) + d^(x.t)ul (2.5) 

1-1 

whara X and u ara undateradned Lagranta nul- 
tlpllar vactor fvmctlons of tlaw, having dlaan- 
alon (n X 1) and (q x 1) > respactlvaly. 


Na consldar a fairly ganaral dynamic optimi- 
sation problem, which la subject to one Important 
restriction - tha performance index, ayatem equa- 
tions, and path constralnta must all be linear 
functions of tha control. As will be shown later, 
this leads to a bang-bang solution. He wish to 
find the vector control history u(t) which mini- 
mises tha scalar functional 


J 


♦ (*(tf),tf) + 



(a(x,t) + b^(x,t)u)dt 

( 2 , 1 ) 


subject to t'.w vector system differential equa- 
tions 


Tha necessary conditions for a local minimum 
are 


5a 5b 
5x “ 5x 


.T 5f 
* 5x 




9ci 

■55T+ “i ir“ 


q 

+ X^g + ^ UldJ - 0 

1-1 


(2.6a) 


(2.6b) 


X - f(x,t) + g(x,t)u (2.2) 

and path Inequality constraints 

C£(x,t) + d|(x,t)u <.0 1 - 1,2,.. .,q (2.3) 

The Initial state and time are assumed to be spec- 
ified, l.e.. 


T 

VI i 0> Vi “ 0 if Cl + diu < 0 

(2.6c) 

In addition, the Lagrange multipliers must sat- 
isfy the following terminal conditions. 


X(tQ) — Xq 


X^(tf) - ^ (x(tf),tf) (x(tf),tf) 


while the terminal state and time are subject to 
the p terminal constralnta (p £ n 1) 

i('l(x(tf),tf) - 0 i - 1,2,. ..,p _< (n + 1) 

(2.4) 


(2.7) 

where v Is a (p x 1) undetermined parameter 
vector. If the terminal time la not specified, 
another necessary condition which applies Is 


In the above, x is the (n x 1) state vector, and 
u Is the (r X 1) control vector. The functions 
6 , a and ci are scalar functions of x and t, 
tdille b and d^ are vector functions of dimen- 
sion (r X 1). The vector function f and matrix 
function g have dimension (n x 1) and (n x r), 
respectively. The terminal time tf may be 
either fixed or free. 

The path constraints (2.3) serve to bound the 
allowable values of the control. A path constraint 
Is said to be active If ci + d|u - 0; It is said 
to be Inactive If c^ -f d|u < 0. State variable 
Inequality constraints are not considered In this 
paper; the results presented herein are extended 
to Include state variable Inequality constraints 
in reference 8. 

NECESSARY CONDITIONS POR A LOCAL MINIMUM 

Using the techniques employed In reference 9, 
a Hamiltonian function Is defined as 


3((i(x(tf),tf) ^ 5iKx(t£),tf) 

- '» iTf 

( 2 . 8 ) 

The optimal control Is determined by satis- 
fying (2.3) and (2.6b and c). For given x and 
t, Che functions b, c, d, g, and X are all 
constant. Therefore, the determination of the 
optimal u (for each x and t) is simply a lin- 
ear programming problem, which can be readily 
solved by using the Simplex method (ref. 10). 
Except for singular arcs, which are not consid- 
ered, the optimal control is always determined by 
r active constraints from (2.3). The optimiza- 
tion problem Is simply to choose the r con- 
straints which result In satisfaction of (2.6b 
and c). 

The r constraints which satisfy (2.6b 
and c) change from time to time along the trajec- 
tory. When a change of constraints occurs, the 
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control varlablM Juap diacontlnuouily froa one 
boundary to another. Such control la referred to 
aa bang-bang control, and the polnta at which the 
Juapa occur are called junction polnta. 

DETERMIKATICW OF OPTIMAL TRAJECTORY 

We now aaauae that the linear' prograanlng 
problea haa bean aolved to yield the active con- 
stralnta and the optimal control. If we aaauae 
chat the active conatralnta are conatralnta 1 
through r and fora theae Into a vactor-aatrlx 
repreaentacion, i.e.. 



then we can aolve for the optimal control fcoa 

u • - D"Tc (2.9) 

where Che auperacrlpt (-T) denotea the Inverse of 
the transpose. Also, equation (2.6b) can be re- 
written using vector-matrix representation for the 
active constraints as 

T T T T 
b + X g + u D - 0 

and this equation can be solved for u to yield 

y - - D"l(b + g^A) (2.10) 

Substitution of (2.9) and (2.10) Into (2.2) and 
(2.6a) results in a simpler version of (2.2) and 
(2.6a) 

i - f - gD-Tc (2.11) 


a’’ - - ^ (a - b'^D'^C) - a'^ (f - gD"’'c) 

( 2 . 12 ) 

III. A NEW ALGORITHM 

In this section, the nature of the optimal 
control strategy derived In Section II Is used as 
the basis for a new algorithm for the solution of 
such optimisation problems. 

First, a feasible solution Is obtained which 
satisfies all path and terminal constraints, and 
for which the controls always lie along r con- 
straint boundaries. The Euler Lagrange equations 
are not utilized in the determination of this fea- 
sible solution; It Bay or may not be a local mini- 
mum. Then, it Is shown that the Lagrange multi- 
plier time history can be easily and uniquely cal- 
culated from this feasible solution. The 


optimality of the feasible solution is established 
by consideration of functions of the Lagrange mul- 
tipliers . An laproveaant scheae which makes use 
of nonlinear optimization (gradient search) tech- 
niques to converge to a local minimum Is proposed 
for use In those cases In which the Initial feas- 
ible trajectory la not a local minlBum. 

Feasible Trajectory 

In order for a trajectory to be a local mini- 
mum solution to (2.1), equations (2.11) and (2.12) 
of Section II must be satisfied, and the control 
must satisfy constraints (2.3) and optimality con- 
ditions (2.6b and c). In addition, terminal con- 
straints (2.4) and (2.7) must be satisfied, and 
equation (2.8) must be satisfied if the terminal 
time tf Is free. In developing the numerical 
algorithm for the solution of this problem. It 
will be assuiud Initially that tf is free. 

Later, we will show how to modify the algorltta 
for the case In which tf Is specified. 

We define a feasible trajectory as one which 
satisfies the system differential equations (2.2) 
and the terminal constraints (2.4), and where the 
control u(t) Is consistent with the necessary 
conditions for optimality - that Is, the control 
Is determined by r of the path constraints (2.3) 
at all points along the trajectory. It is not 
necessary that the control be determined by Che 
same r constraints at all points along the 
trajectory - In fact, we will usually require the 
control to be determined by several different con- 
straint sets, as will be seen shortly. Such a 
trajectory may or may not be a local minimum solu- 
tion for the perforciance index (2.1). 

In order to obtain a feasible trajectory, 
there are p terminal constraints (eq. (2.4)) 
which must be satisfied. In general, there must 
be p degrees of freedom available In order to ' 
satisfy the p terminal constraints. In order to 
provide these degrees of freedom. It will be as- 
sumed that there are p segments In the trajec- 
tory. For each segment , the control Is determined 
by choosing the r constraints which are active. 
The set of active constraints may be chosen arbi- 
trarily for each segment except that Che con- 
straint sets may not be Identical for any two 
adjacent segments. The durations of the p seg- 
ments are variable, and provide the p degrees 
of freedom necessary to satisfy the p terminal 
constraints. 

The choice of the constraints to be active 
for the various trajectory segments should be niade 
carefully. There Is no guarantee that a solution 
exists for arbitrary choice of the active con- 
straints, or for any choice of active constraints, 
for that matter. 

The combination of p degrees of freedom and 
p terminal constraints Is known as a multipoint 
boundary value problem, and must generally be 
solved Iteratively. Two widely used classes of 
methods for solution of such problems are Newton- 
Raphson methods and gradient methods. 
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These backwsrd solutions are called 


It was aaauMd In the above dlscuealon that 
the terminal time tf la free. If tf le fixed, 
than the duration of the final segment does not 
provide a degree of freedom. Therefore, there 
uat be (p * 1) aegmdnta for p terminal con- 
attaints, and Che durations of the first p seg- 
ments provide the necessary degrees of freedom. 

CALCTJLATIOH OF LAGMMCE MULTIPLIERS 

V)e ccnsider first the case in which the term- 
inal time la free. Suppose a feasible trajectory 
has bean found. We will show that the Lagrange 
niltlpllers X and m can be uniquely calculated, 
as a function of time. Once Che multipliers have 
been calculated, the local minimality of the fea- 
sible trajectory can be checked. If the feasible, 
trajectory Is not a local minimum, an iterative 
Improvement scheme Is developed which converges 
to a local minimum. 

Let the iih trajectory segment have initial 
time ^l-i *i^d final time tj^. The control for 
the Itn segment was determined by a set of r 
active constraints, and the control just prior to 
tj^ is denoted by uCt^). Just after t ■ t^, the 
control is determined by different active con- 
straints, and is given by u(t^) ^ uCt^). It may 
be shown (ref. 9) that the Hamiltonian must be 
continuous at t ■ t^. Therefore, we must have 

[b''^(ti) + xTg(ti)][u(tt) - u(tj)] - 0 

i - 1.2..,., (p - 1) (3.1) 

Equation (3.1) must be satisfied at each of 
the (p - 1) Junction points between trajectory 
segments. Also, as shown In reference 9, the 
terminal X and H must be given by (2.7) and 
(2.S). If we use (2.5) for H, and substitute 
for u and X from (2.9) and (2.7) respectively, 
equation (2.8) 1s converted to 


_ dd(t{) -f m 

dt(tf) + -J-jy +a(tjF) -b (tf)D (Cf)C(tf) - 0 

(3.2) 

Equations (3.1) and (3.2) give p equations which 
must be satisfied, and there are p multipliers 
which may be varied. Thus, we have a multipoint 
boundary value problem, similar to that which must 
be solved iteratively to determine a feasible tra- 
jectory. However, in the present case, iterative 
solution is not required. Instead we can solve 
for the parameters v as follows; 

First, we find (p + 1) backward solutions of 

the i equation (2.12) for vl ■ (0 0), 

vT - (1,0,. ...0). vT - (0,1,0 0) 

v’^ • (0.0, . . . ,0,1) where 


X’’(tj) 


M. + 

3xf 


9iji 

3xf 


X^‘*^(t). X^^^t) x(P>(t) (3.3) 

Then X(t) is given by 


X(t) - X(°)(t) + A(t)v (3.4) 

where A(t) is defined as 

A(t) S [x(l)(t) I ... 

There are (p - 1) equations for the contin- 
uity of H: 

[u(t+) - u(tj)]^[b(t^) + g‘T(tj)x(o>(tj) 


i ‘'"’I 


(3.5) 


+ 8^(tpA(tp^-0 1-1,2 (p - 1) (3.6) 


and at t^, we must have 


a(tf) -b^(tf)D ^(tf)C(tf) + H (tf) ■*‘(|f(tf)) V « 0 


(3.7) 

these equations may be put in matrix form as fol- 
lows: 


Define vectors and qj and matrices Q 
and R by 

q^ - [u(ti) - u(ti)j^g3^(tf)A(ti) 

i - 1 (p - 1) 

tj - [u(t+) - u(t-)]^[b(t^) + g'^(t^)X<°^l j] 



% • • b'^Ctj)D-'T(tj)C(tj) +1^ (tf) (3.8) 
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Than v say ba calculatad froa 

V - - Q“^R (3.10) 

Onca tha v ara known, (2.7) can be uaed to 
calculate X~(tf), and X(t) can be obtained by 
Integrating (2.12) backward in time, or by ualng 

( 3 . 4 ). 

Fixed Final Tlae 

In the abov'': developaent. It was assumed that 
Che terminal cine t£ is free. In the event that 
Cf la fixed, the equations for calculation of v 
are easily modlfiad. In this case, (3.2) is not 
applicable. Instead, there are p of equations 
(3.6), instead of (p - 1), sln:e there are (p + 1) 
segments for this case. Tha p equations (3.6) 
are sufficient to calculate the p parameters, v. 

Improvaswit of Feasible Tralectorv 

The Lagrange multipliers can be used to de- 
ceimlne if the initial feasible trajectory is a 
local minimum. The optimal control is obtained as 
a function of time by using equations (2.6b and c), 
with x(t) and X(t) as determined from the fea- 
sible trajectory. If uopt;(c) is identical to 
the control time history ufe(t) utilized in the 
feasible trajectory, then the initial feasible 
trajectory is a local minimum, and no further cal- 
culation need be made. On the other hand, if 
uopt(c) differs from ufe(t) for even a portion 
of the trajectory, then the feasible trajectory is 
not a local minimum. 

Suppose, for example, the control Uopc(t) 
differs from ufe(t) during trajectory segment k. 
Then the performance index (2.1) can be Improved 
by splitting segment k into two parts, and using 
control as follows. 

“ “opt(*:>» *:k-l £ t 1 tsw 

(3.11) 

u(t) - ufe(t), 1 t < tjj 

where tgy should be chosen to be only slightly 
greater than tk_i, so that the modified trajec- 
tory differs only slightly from the Initial fea- 
sible trajectory. Because of the modified control 
history, the new trajectory will not satisfy the 
p terminal constraints (2.4). Therefore, the or- 
iginal p junction times should be adjusted, 
while holding tg,, fixed, so that the terminal 
constraints are satisfied. Since the trajectory 
was modified only slightly from the initial fea- 
sible trajectory, the process of reconverging the 
trajectory should be accomplished easily. 

Once a modified trajectory has been obtained 
and the terminal constraints satisfied, the 
Lagrange multiplier time history may be calculated 
for the modified trajectory in the same manner as 
it was calculated for the initial feasible tra- 
jectory. From the Lagrange multipliers, the grad- 
ient of the performance index with respect to the 


switching time, l.e., BJ/Stg^ can be obtained. 
It is shown in reference 8 that 

■ H(tg„) " X (tgy)g(tgy) 


*'<‘w>]‘^‘'^<^ew)[“<t;„)_u(t+„)] (3.12) 

The set of all such switching points tgv, 
and corresponding gradients, can be used in con- 
junction with a nonlinear search technique to 
search for the values of tgy such that the 
gradient vector 3J/itgv 1* equal to, or nearly 
equal to, zero. At this point, a local minimum 
solution has been achieved. 

IV. PIECEUISE-LINEAR MOI^LS 

An Important special case of the probloi 
considered in Sections II and III is when the 
performance index, system equations and path con- 
straints are all linear in both the state and the 
control. This case occurs frequently in practice 
because linear approximations to complex dynamic 
systems ace readily available. Furthermore, 
solutions to linear problems ace easier and less 
costly to obtain because the system and Euler- 
Lagrange equations can be Integrated in closed 
form. 

If the actual system is only slightly non- 
inear, a single linear approximation to the non- 
linear system may suffice over the full operating 
range. However, if greater accuracy la desired 
and/or the actual system is very nonlinear, a 
series of linear models may be used, each of 
which is obtained by linearizing about a different 
equilibrium point. Linear equations are still 
used to describe the systeit at each state point, 
but coefficients in the linear model vary from 
point to point. Such a model is called a piece- 
wise linear model. 

Suppose, for example, the nonlinear system is 
linearized about a number of equilibrium points. 

In the neighborhood of each equilibrium point, we 
have 

X - Fj(x - Xgj) + Cj(u - Ugj) (4.1) 

where Xgj and ugj are the equlllbriimi values 
of state and control at the equilibrium point j. 
The system matrices Fj and Gj also differ, in 
general, for each equlllbrlura point. The path 
constraints may also be linearized about each 
equilibrium point Co yield 

Cij(x - Xgj) + d^j(u - u^j) ■*- ejj < 0 

1 - 1,2,.. .,q (4.2) 
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The p«th constraint vactota cij and d^j alao 
dlffar for aaeh aqulllbrlua point. 

With a plecoHlae linear model, the syateai la 
daacrlbed by line r aquations at each state point, 
but the linear aystek coefficients vary from one 
point to another. A question chat srlsea Is 
which equilibrium modal applies best for a given 
state, x7 It la natural to chooae the equlllb*- 
rlum point which is closest to x In some sense. 
Since the various states do not necessarily have 
the same physical dimension, a nonsallsad dis- 
tance function Is used to determine which equilib- 
rium point Is closest. For a given state x, the 
distance functions 

Ij - (x - x^j)^W(x - x^j) (4.3) 

are calculated for each equilibrium point J , and 
the equilibrium point Is chosen for which Ij la 
a minlsHim. 


H - a^x + b^u + + OjCu - u,^) 

^ "ifij^* • *«j> * * •ijj 

1-1 ^ 

and the Euler-Lagrange equations are 

q 

- - aT - - ^2 mcij 

1-1 

where the model index j Is the same function of 
time as determined by Integration of the systam 
equations. In addition. It is shown in refer- 
eace 9 that the Lagrange multipliers are discon- 
tinuous at model switching points, the jump In A 
being given by 


Since the I, are continuous functions of 
X, model switches^ (say, from J to k) occur when 
Ij - or 


where 


(x - x^j)^W(x ~ ” *ek^ 


X(tg) - X(tg) + 



Necessary Conditions for Optimality 

The problem Co be solved is to minimize 
tf 


I 


J - 4(x(t£),t^> + / (a^x + b^u)dt 

subject to the system differential equations 
X - Fj(x - Xgj) + Gj(u - Ugj) 
and path Inequality constraints 


Cij(x - Xgj) + djj(u - ugj) + 1 0 

1 - 1.2,. ..,q 

whei e Che linear model Index J Is determined 
fro* 

T 

mln(x - x,)W(x-x.) 

^ ej ej 

The Hamiltonian Is defined as 


and tg Is the time at which the model subscript 
changes from J to k. Furthermore, since the 
switching time is not specified a priori, the 
Hamiltonian must be continuous at t ■ Cg. 
Therefore, we must have 


(X(tg) + eaji^)^x(tg) - X^(tg)x(t”) (4.5) 

which gives 

^^(t')[*(tg) - i(tg)] 

e T ~ / 

V. DEMONSTRATIVE EXAMPLE 

The Ideas developed In Sections II through IV 
are Illustrated In this section with the aid of a 
numberlcal example. A problem will be solved In 
which the system equations are nonlinear In the 
state and linear In the control. 

Problem Statement 


Consider 

the problem of finding u(t) 

which 

transfers the 

system 



A • - x^ + u 

(5.1) 


y • - 4y + u 
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■ubjtct to tht control liiiitt |u{ £ 2 froa Initial 
conditions (xoiyg) " (1>1) to taralnal condltlms 
(xf>yf) “ (OtO) In nlnlatua tlaa. 

Ws hava in (2.1). (2.3) and (2.4) 

♦■tf,a-b"0 


C'l ■ - 2, dj^ ■ - 1 

Cj - - 2, d2 ■ 1 

♦i * *f *2 ■ yf 


(5.2) 


Tha Raalltonlan (2.5) la 


Itarativa solution of (5.9) for tx snd tf such 
that x(t{) ■ y(tf) • 0 rssults In 

tx ■ 0.56, t£ ■ 0.69 

CALCULATION OF UCRANCE MULTIPLIERS 


For this problsB, we have Sf/Sx ■ 0 and 
}p/3x " I. Therefore, X(tf) “ v. We Bust Inte- 
grate (S-4) backward with three acta of Initial 

conditions - X<°^tf) -(“), X^^^tf) - (J), 

X^^^(tf) " In order to find A(tj) and 

X^^^(t]^). Equations (5.4) nay ba intagratad In 
closed fora as follows: 


H" Xx(-x^ + u) + Xy(-4y+ u) + ux(-2 - u) + W2("2+ u) 

(5.3) 


and the Euler Lagrange equations are 
xi - 2XxX 
Xy * 4Xy 

The control Is detemlned fron 
aln(X^ + Xy)u 


(5.4) 


(5.5) 


which results In 

u •• -2 agn(Xx + Xy) (5.6) 

The teralnal conditions on the Lagrange i&ultl- 
pliers are 


X(tf) - V 
H(t{) - - 1 


(5.7) 


Xy(t) “ Xy(tf)e*^* 


x_it) 


-2X,(tf ) - 2Xy(tf) - XyU) (-4y (t) + 2) 


-x2(t) + 2 
Therefore, we obtain 


>tit, 


0 -(T) -O 

Equations (3.6) and (3.7) give 


.(0) 


and 


Which can be expanded to give 


Initial Feasible Solution 

Since there are two temlnal constraints and 
the terislnal tine Is free, the Initial feasible 
trajectory vuat have two segnenta. The only pos- 
sible control for these segments Is u - >2. 
Therefore, we assume tentatively that the optimal 
control history Is given by 

u • -2, 0 £ t £ t, 

(5.8) 

u “ 2, tx £ t £ tf 

with t and tf to be determined such that 
xf * yf " ()• state equations (5.1) can be In- 

tegrated In closed form when (5.8) Is used as the 
control. The result Is 


1.035Vf + 0.595W2 “ 0 
vx + V2 “ - 0.5 
Solving for and uj yields 

UX - 0.676, V2 - - 1.176 

Therefore, from (5.7) we have 

Xx(tf) - 0.676, Xy(tf) ■ - 1.176 (5.10) 

For this problem, the state equations and Euler- 
Lafiange equations can be Integrated In closed 
form. The result is 


1 - tan tx 

x(ti) 1 

1 + tl 

1 -4tx ”4t] 

y{tj) - -Jd-e ) + e (5.9) 
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»y(t) • 

X,(t) 


- 1.176* 




-1 - !^y{t)(-4y(t) + 2) 



-* (t) + 2 






-0.252 + 1.414 t«nh 'fl (t-t,) 

x(t) ^ 

1 - 0.17S tanh (t • 

y(t) - 0.5 -0.340 

(5.11) 


)iy(t) - 

- 0.699 

X^(t) - 

1 - Xy(t)(4y(t) + 2) 

x^(t) + 2 

x(t) ■ 

1 - 1.414 tan t 

1 + 0.707 tan /2 t 

y(t) - - 

- 0.5(1 -e"^^) + e‘'*^ 


HICINE MOPgL 

Bacauaa of tha virtual lapoaalblllty of ua- 
Ing nonlinaar feadback control thaery for roAlia- 
tlc aystMw. control ayataa aoftwave la uaually 
davalopad ualng llnaar wdala. 7or turbofan «- 
gine control ayataa daaign. nonlinaar dynaaitc 
alaulationa auch aa rofaranca 11 ara llnaarliad 
about varioua aqulllbriuai conditional and linear 
Bodala obtained. Thla proceaa producea equatlona 
of the fora 


i - F(x - X,) + 0(u - u,) (6.1) 

where x, and u^ are cqulllbrlua valuea of 
atate and controli raapectlvely. Ocher engine 
varlablee which are not auxlelad aa atataa ara 
alao of Intaraat. Such variablaa will be called 
oucputai and denoted by y. The llnearlted out- 
put equatlona ara given by 

y - + C(x - X,) + D(u - u,) (6.2) 


If Che outputa have upper (or lower) bomida which 
suat not be exceeded, then combined atatc/control 
path Inequality conacralnta of the form 


ye + C(x - xe) + D(u - Ue) - < 0 


(5.12) 

Optimality at Injtlal Feaalble Solution 

The Initial feaalble trajectory wee obtained 
under the tentative aasuaptlon that the optimal 
u(t) la given by (5.8). According to (5.6), thla 
control atracegy la optimal only If 


Vfflln - ye - - *e> ' ~ «e) 1 ° 

(6.3) 

are produced. Mechanical llmlta on the control 
varlablea elao have the general form of (6.3) 
with C - 0. 


Xx + > 0, 0 < t < ti 

X, + Xy < 0, tj < t < tf 


(5.13) 


To determine If thla la the caae, (Xj^ + Xy) la 
calculated aa a function of time from (5.11) and 

(5.12). The reault la plotted In figure 1, and 
ahowa that for thla problem, the Initial feaalble 
trajectory la a local minimum. Therefore, no fur- 
ther improvement needa to be made. The optimal 
trajectory, x(c) and y(t), la ahown In figure 2. 

VI. APPLICATIOM TO TURBOFAM CONTROL 


TRAMSIENT PERFORMAMCE 

We conalder the problem of mlnlmlilng Che 
time required to accelerate Che FlOO engine from 
one equilibrium power aettlng to another aa rap- 
idly aa posalble. In aolvlng thla problem, a 
plecewlae-llnear model oi the FIDO engine will be 
uaed, having three atate varlablea and four con- 
trol varlablea. There are four equilibrium linear 
modela at power level angle (PLA) aettlnga of 36, 
52, 67 and 83 degreea. The coefficient valuea In 
(6.1) to (6.3) are different for each of the 
modela. The linear model which appllea at a 
given time la aelected by minimizing the quad- 
ratic function 


In thla chapter, the algorithm deacrlbed In 
Sectlona III and IV la uaed to find optimal tra- 
jectorlea for an aircraft turbofan engine. Spe- 
cifically, valuea of the control varlablea are 
found aa a function of time, which allow the 
engine to accelerate from one ateady atate power 
aettlng to another aa rapidly aa poaalble, while 
adhering to the engine constralnta. 


Ij • (x - Xgj)^W(x - Xg^) (6.4) 

with reapect to 1; the model whoae equilibrium 
at.ite la "closeat" to the actual state at that 
time la chosen to represent the engine. 

The trajectory must also satisfy path In- 
equality constraints given by 
T T 

c^x + djU + Pj < 0. 1-1... .,q (6.5) 
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Tha coafflclnta e^t and a^ ara diffarmt 
far aach aqulltbrlua KMal. Som of tha path la- 
aqualttp eoaatralata corraapand to anflna phyalcal 
llaita« othara to control aachanical llalta. Spa- 
clfleally, tha conatramta which apply to thla 
prablaa ara: 

(1) Turbina Inlat traparatura cannot aacaad 
tha aqulllbrlun valua at tha PLA ■ 83° 
a^lllbriun point by aora than 50 da- 

sraaa. 

(2) Pan and coi^raaaor apaada cannot ascaad 
tha a^uUlbriua valuaa at tha FLA “ 83° 
a^lilbriun point by nora than SO RPM. 

(3) Pan and conpraaaor aurga narglna nuat not 
ba laaa than fiva parcant* 

(4) Inlat gulda vanaa, conpraaaor vanaaf ax- 
hauat neifla araa and fuel flow rata Kiat 
net axcaad thalr nachanical llalta. 

Tha problMB to ba aolvad la atatad aa fol- 
lowa. Fled controla u(t), 0 < t ^ tf which 
alnialxa tha tamlnal error function. 

•'»(' • Z 

«Alla actlafylng the ayatm equationa (6-1) and 
path conatralnta (6.3). A aaquanea of aolutiona 
to auch problMa for diffarant acceleration tinea 
tf awy be uaed to find the nlnlnun tine aolution 
for a given value of tenalnal error. Hecaaaary 
eondltlona for an optimal aolution era given In 
Section II . Tha problem la aolvad by uaing the 
new algoritta daacrlbad In Sect Iona III and IV. 

RESULTS 


Conaidar tha problem of mlnlalalng the term- 
inal error for an acceleration from a part-power 
condition (PLA - 36°) to Intermediate thruat. The 
final time la apeelfled to be tf ■ 0.6 aeconda. 
The problem varlablea (atatea, outputa and con- 
trola} for the optimal trajectory are ahown in 
figure 3. The atate varlablea, fan apeed, con- 
preaaor apead and augnentor praaaure, ara ahown aa 
functlona of tlaM In figure 3(a), (b), and (c). 

It can be aeen that the atatea approach the de- 
alred final valuaa aaoothly and tdth no overahoot. 

The outputa are ahown aa a function of time 
In flgurea 3(d) to (g). Becauae of the way In 
which the outputa are defined In equation (6.3), 
theae varlablea are In general dlacontlnuoua «t 
model Bwltchlng polnta and polnta of dlaeontlnu- 
oua control. However, If the plecawlae linear 
au>del la a good repraaentatlon of the engine, the 
diaconLlnultlea In the outputa at model awltchlng 
polnta ahould be email. In figure 3, the dlaeon- 
tlnultiea In the outputa are, for the moat part, 

BO amall that they are not vlalble. Theae dla- 
contlnultlea are aubatantlal only for the fan and 
conpraaaor aurga marglna. 


The optimal control atrategy ealla for turbine 
inlet tMperatura to have Ite maxlMm value for 
Che mtlra trajectory} thle la ahown In figure 3(d). 
Fan and conpraaaor aurga urglne remain well above 
acceptable mlnlaiaa (flga. 3(f) and (g)). Thruat 
(fig. 3(a)) inereaaaa amoochly and monotonlcally 
with time. 

The controla are ahown aa a function of tlma 
in flgurea 3(h) to (k). Fuel flow jwapa at t ■ 0 
from Ita Idle valua, thm inereaaaa alowly to 
maintain conatant turbine Inlet taaparature. Tha 
optimal valua of notala area la conatant. Tha In- 
let guide vanaa and compreaaor variable vanaa are 
conatralnad to be within +7 degreea of the 8111- 
of-Materlal control achaduled valuaa. 

VII. COSCLUDIWC RBIARKS 

A new algorithm haa been preaented for aolu- 
tion of dyaiwlc optlmlaatlon pr^lMa which are 
nonlinear In Che atate varlablea, and linear In 
the control varlablea. It la ahown that the op- 
timal control for auch problema la bang-bang, ex- 
cept for poaalble alngular area, which arc net 
conaldered. The algorithm requlrea chat a nominal 
bang-bang aolution be found t^t aatlaflca the 
ayatam equationa and terminal conatralnta. The 
Euler-Lagrange equationa are not utilized In the 
determination of thla feaalble aolution; It la 
generally not a local minimum. Equationa are de- 
rived for the determination of the Lagrange mul- 
tlpllera (aenaitlvlty functlona) which correapond 
to the Initial feaalble aolution. Theae aenai- 
Clvlty functlona are then utilized, along with 
nonlinear optimization (gradient aearch) tech - 
nlquea, to converge to a local mlninw. 

The new algorltiaa haa aevcral advantagea over 
methoda currently In uae for aolution of auch 
problema. Firat, the ayatem dyna*'iilc equationa are 
imcoupled from the Euler-Lagrange equationa: the 

Euler-Lagrange equationa are not utilized In the ' 
determination of the initial feaalble aolution. 
Second, uae of the new algorithm nlnlmiiea Che 
nu^er of varlablea Involved in the gradient 
aearch. With tha new algorithm, the aearch var- 
lablea are the conatralnt awltchlng timea - the 
Clmea at which awitchea take place from one net of 
conatralnt functlona to another. Other methoda 
currently In uae generally dlaeretlze the trajec- 
tory into a large number of intervale , and aearch 
for the optimal valuea of the controla for each 
Interval, 

LIST OF SYMBOLS 

a acalar function In perforawnce index (2.1) 

b (r X 1) vector function In performance 

Index (2.1) 

c, acalar path Inequality conatralnt function 

In (2.3) 

C (r X 1} vector function of active conatralnta 

d. (r X 1) vector path Inequality conatralnt 

function in (2.3) 


9 



D (r X r) matrix lunptlon of actlva con - 
atralnta 

a^^ scalar path constraint limits 

f (n X 1) vector of systsm functions 

P (n X n) constant system matrix 

• (n X r) matrix of conc'ol distribution 

functions 

G (n X r) constant control distribution 
SMtrlx 

H variational Hamiltonian 

distance functions 
J performance index 

n number of states 

p maber of terminal state constraints 

FLA power level angle, deg. 

q nu^er of path inequality constraints 

q^ vectors defined by (3.10) 

Q matrices defined by (3.11) 

r niffiber of controls 

r^ vectors defined by (3.10) 

R matrices defined by (3.11) 

t time 

u (r x 1) control vector 

W (n X n) weighting matrix 

X (n X 1) state vector 

y Output variable 

Oji^ model switching vectors 

e jump parameter 

V (p X undetermined parameter vector 

1 (n X 1) undetermined Lagrange multiplier 

vector 

A (n X n) block-diagonal system matrix 

Uj scalar undetenslned Lasronge multiplier 

i scalar function of terminal conditions In 

( 2 . 1 ) 

scalar terminal constraint function 
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Figure 2. - Initial feasible trajectory for ex- 
an^le problem. 
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<d) TURBINE INLET TEMPERATURE. 



(e> THRUST. 

Figure 3. - Acceleration from part- 
power to intet mediate. 
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